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A JOB ELEMENT EXAMINATION FOR STATE TROOPERS 


Background 

Police examining is not a new 
concern of the Federal government. 

In 1922, the U.S. Civil ' Service 
Commission used a situations test 
to select candidates for police 
work, assessing their judgment in 
handling hypothetical police situ- 
ations (Assembly of Civil Service 
Commissions, 1924). Fifty-three 
years later two Commission staff 
members served as part of a consult- 
ant team to develop another situ- 
ations test for police, this time 
for the job of New York State 
Trooper. Many other police examina- 
tions have been developed by the 
Commission over these five decades. 
How has our examining methodology 
changed during these years? What 
kinds of nontechnical considerations 
currently have a bearing on who will 
be hired to perform this socially 
significant job? 

As psychologists now develop 
and document examinations — especially 
for police and firefighter agencies 
with an underrepresentation of minor- 
ities and women — they work as part of 
a real or imagined interdisciplinary 
team that may eventually involve 


attorneys and judges. And to make 
matters even more complex, recurring 
economic concerns, such as the sup- 
ply and the demand for jobs and bud- 
get crises facing public agencies, 
compete with technical judgments in 
determining which selection proce- 
dures will be used, and how these 
procedures will be used. 

The purpose of this paper is to 
highlight how Primoff's job element 
method (Primoff, 1975; Hardt, Eyde, 
Primoff, and Tordy, 1981) has been 
used in a project to select police. 
This paper will focus primarily on 
the Situations Test, a written exam- 
ination developed for this project, 
on which minority group members 
tended to score substantially lower 
than the white candidates. In an 
earlier paper (Eyde, Hardt, and 
Primoff, Note 1) on women in police 
work, findings were presented on the 
Physical Performance Test, and the 
relevant results will be summarized 
in this paper. Steps taken to 
assure equal opportunity for minor- 
ity group members will be reported, 
along with the impact that economic 
concerns had on affirmative action 
efforts and other aspects of the 
selection process. 


This report is baaed in part on a paper presented at the 1977 Convention of the American 
sychological Association, Division 14, the Division of Industrial and Organizational Psy~ 
chology, for the symposium on "Alternative Choices in Job-Related Police Examining: What's 
the Correct Answer?" San Francisco, California, August 30, 1977. The report relates to a 
project supported by the Law Enforcement Assistance Administration of the U.S. Department 
of Justice (LEAA Contract C-66465) and the New York State Division of Criminal Justice 
Services (DCJS Proposal No. 1279-A). The contents of this report are the responsibility of 
the authors and do not represent the official position of the Law Enforcement Assistance 
Administration. 

The research and development project was under the general supervision of the New York 
State Police Deputy Superintendent Warren B. Surdam and was carried out by Captain George R. 
Tordy and members of the Job Analysis Detail. 

The authors acknowledge the clerical assistance provided by Georgiana Byrnes and Peecv 
Peterson. b 
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Job Element Method 


The job element method has had 
wide application in employee selec- 
tion in Federal, State and local 
agencies. It is the sole examining 
method used for selecting Federal 
blue-collar workers, but since its 
inception it has also been utilized 
to select white-collar workers 
(Primoff, 1957). The method 
identifies job elements, the funda- 
mental units describing critical 
worker requirements, and excludes 
the use of general credentials and 
standards, such as the high school 
diploma and height and weight 
requirements, as elements. The pro- 
cedure may be used to provide the 
foundation for many aspects of a 
job-related personnel system, includ- 
ing recruiting, examining, training, 
and performance appraisal. 

The method has evolved under 
the guidance of Ernest S. Primoff, 
who was introduced to the underlying 
concepts by Carroll L. Shartle 
(Primoff, Note 2), an early leader 
in the development of job analysis. 

The origins of the element con- 
cept can be traced back to the early 
history of psychology. For example, 
Wilhelm Wundt, who one hundred years 
ago established the world’s first 
psychological laboratory in Leipzig, 
urged that we "remember the rule, 
valid for psychology as well as for 
any other science, that we cannot 
understand the complex phenomena, 
before we have become familiar with 
the simple ones" (Wundt, 1912, 
p. 151). Job element examining seeks 
to identify the detailed attributes 
that differentiate highly effective 
workers from marginal workers, con- 
sidering the frequency with which 
these attributes exist in the appli- 
cant population and the trouble that 
might . occur if the identified char- 
acteristics are not considered in 
the selection and training process 
(Primoff, 1975; Primoff, Note 3). 
Miinsterberg, the founder of applied 
psychology, also stressed the im- 
portance of the element approach. He 
pointed out that for jobs that are 
too complex to reproduce in a test 
as an "undivided whole," it is nec- 


essary "to resolve the mental proc- 
ess into its components to test 
every single elementary function in 
its isolated form" (Miinsterberg, 
1913, p. 59). Existing procedures 
may then be used instead of develop- 
ing new tests for every job. Put 
in contemporary terms, job element 
examining does this by linking the 
content of the examination to the 
important requirements of the per- 
formance domain. 

The job analysis phase relies 
upon systematic procedures to 
obtain the judgments of experienced 
job incumbents and supervisors about 
critical worker requirements. The 
requirements are not confined to the 
cognitive domain; the full range of 
performance is covered, including 
affective and psychomotor compo- 
nents. Although the method is com- 
prehensive in its scope, it does not 
require the assembly of an inventory 
of tasks as an intermediary step but 
proceeds directly to an identifica- 
tion of worker requirements. 

The test development phase em- 
ploys job incumbents who, under the 
guidance of measurement specialists, 
create the test content based on 
the identified worker requirements. 
When possible, the method verifies 
the linkage with job elements by 
examining relationships between sub- 
test performance and external crite- 
ria of performance. As Humphreys 
(1975) recommends, indicators of im- 
portant worker characteristics such 
as honesty, dependability, initia- 
tive, and emotional maturity may be 
sought. Self-ratinqs , documented by 
accounts of life experiences, may 
provide useful information about 
such characteristics. As early as 
1962, such self-rating data were 
used to select Mobile Lounge Opera- 
tors for Dulles Airport (Primoff., 
Note 4). In job element examining, 
self-ratings are based on subele- 
ments found to be important to the 
job. The ratings may be used as a 
research variable and as a selection 
procedure which may reduce adverse 
impact on the basis of sex, race, 
and ethnicity ( Primoff , 1980) . This 
approach is quite different from the 
use of self-ratings based on factors 
from unrelated studies. Heneman has 
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pointed out that such uncritical use 
lacks "theoretical concern with why 
one might expect SAs [self-assess- 
ments] to significantly correlate 
with the criterion in the first 
place, or with specification of fac- 
tors that might condition the size 
of the correlation. Future research 
on SA in selection must be guided by 
stronger theoretical underpinnings. 
Primoff has provided a start in this 
direction" (Heneman, 1980, pp. 297- 
298) . 


Overview of the Trooper 
Examination 


Now let us turn to the practi- 
cal job assigned to the authors as 
consultants to the New York State 
Police ( NYSP ) project — that of 
designing an examining system. We 
recommended basing all selection 
decisions on the results of an ex- 
tensive job analysis. The high cost 
of examining large numbers of candi- 
dates, together with a shift in 
organizational priorities resulting 
from a severe fiscal crisis, narrowed 
the job element portion of the exami- 
nation down to the Situations Test 
and the Physical Performance Test. 
Ideally, the job element examination 
would also have included empirically 
weighted self-ratings, an assessment 
center-type exercise, a background 
investigation, a medical examination, 
and a structured oral examination. 

The screening process also 
included administratively determined 
minimum requirements such as educa- 
tional level and age. After candi- 
dates were ranked on the basis of 
their scores on the Situations Test 
and the Physical Performance Test, 
veterans' credits were added as 
required by the New York constitu- 
tion. Finally, candidates received 
a screening, not based on the job 
element method, consisting of a 
pre-employment interview, a medical 
examination and a background inves- 
tigation. 

Self-rating data based on the 
critical requirements of the job 
were collected but not used in 
screening candidates except as the 


candidates themselves chose to use 
them for self-screening purposes, 
possibly serving to screen in the 
more qualified candidates and to 
reduce the number of less qualified 
applicants. The candidates were re- 
quired to support their ratings on 
four major elements by describing 
their life experiences, including 
job experience and training, mili- 
tary service, and avocational 
activities. 

The immense size of the ex- 
pected applicant pool recurrently 
surfaced as an issue during tech- 
nical discussions. This was a 
concern even when the first ex- 
amination was given to select New 
York State Police 60 years aqo 
{"255 Candidates in Test for New 
York State Police Jobs," 1917). 

At the time, a physical examination 
had eliminated more than 1,100 can- 
didates. The remaining 255 candi- 
dates were examined on the mental 
test, which included Miinsterberg 1 s 
measure of powers of observation 
as well as questions on the candi- 
dates' knowledge of horsemanship. 

In 1975, the concern for applicant 
population size proved to be a 
realistic one, for the examina- 
tion was administered in a period 
of high unemployment, particularly 
in large cities such as New York 
and Buffalo, in which extensive 
minority group recruiting efforts 
had been concentrated. A total of 
30,500 applications were received, 
including 4,159 (14%) from minority 
group members and 1,847 (6%) from 
women. Over 22,000 candidates 
appeared to take the 22-item Situ- 
ations Test, of which 19 items were 
scored, even though it was antici- 
pated that during the four-year 
life-expectancy of the eligibility 
list a maximum of only 800 (3.6%) 
of the candidates could be hired. 
Actually only 548 (2.5%) of the 
applicants were hired. 


Meeting Legal and Professional 
" Requirements 


At the time the consultant 
team began its work, less than 1% of 
the NYSP Trooper population was made 
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up of; minority group members, and 
the first four women Troopers were 
beginning their field work after 
graduation from the police academy. 
Thus, equal employment opportunity 
( EEO) concerns were predominant 
throughout the test development proc- 
ess, including the job analysis, the 
development of the scoring key, the 
selection of the test items, and doc- 
umentation of the validity of the 
tests . 


Job A nal y s i s 


similar importance to critical 
requirements of the job. The final 
results of the job analysis identi- 
fied BO minimum requirements along 
with 223 subelements, or ranking 
requirements, which defined the 
specific content of the job that 
differentiates between effective 
and marginal workers. These sub- 
elements were classified by police 
panelists under 15 job elements 
such as: Thoroughness, Good Judg- 
ment, and Ability to Communicate 
Well with Others. 


The consultants chose to expand 
the usual six-person panel that, in 
the job element procedures, estab- 
lishes the important requirements of 
the performance domain. A total of 
155 NYSP panelists, with a wide 
range of experience involving cover- 
age of major and minor crimes as 
well as highway patrol work, partici- 
pated in generating over 1,400 job 
element statements. As a result, a 
data bank of worker reouirements has 
been established and is available to 
other police agencies (Tordy, Eyde, 
Primoff, & Hardt, 1976). The panel- 
ists represented 5% of all the 
Troopers and 0% of the supervisors 
from the nine troops distributed 
throughout the State. Over half 
of the panelists represented rural 
stations, in keeping with NYSP's 
chiefly rural constituency. (The 
NYSP does not carry out patrol func- 
tions in any of the State f s cities 
but does patrol in the suburbs.) 
Special groups such as those in- 
volved in the 1973 Minority Group 
Recruiting Detail and the traffic 
safe ty details were included. The 
job element statistic known as the 
Total Value score, which identifies 
trie most important worker cbarac- 
t eristics, was obtained for each 
requirement, and these scores were 
analyzed. The Total Value scores 
tor the top 591 job element state- 
ments for 134 white males were cor- 

Wlth the SCOCes obt ained for 
1 6 NloP minority male group members 
ais well as four white women Troopers. 
Tine intercorrelations were high and 
s tatistically significant (p < .01) 
.87 for minorities and .84 for the 
women,, indicating that white males 
women, and the minorities assigned' 


Situations Test 

The 1975 Situations Test was 
not a traditional multiple-choice 
written test. Test candidates were 
exposed to an open-book mini-learn- 
ing situation involving 69 hypo- 
thetical police rules. Then they 
applied these rules usinq their 
judgment and common sense to choose 
which were the best and worst alter- 
native actions that might be chosen 
from a list of actions ranging from 
6 to 13 in number, depending on 
the requirements of the situations. 
(Table 1 shows a sample test item 
with keyed values for each alterna- 
tive and item statistics from the 
test administration for four sub- 
groups.) in order to measure crit- 
ical job requirements rather than 
merely verbal ability, a low read- 
ing level was used, and subject- 
matter experts (the Job Analysis 
Detail, see Tordy et al., 1976, 
p. 11) were asked to describe situ- 
ations in which Troopers had to make 
decisions based on their behavioral 
styles established before training 
at the police academy. Alternative 
actions for each situation were 
to be stated without reqard to a 
ogically supportable "best answer 11 
that could be determined by verbal 
reasoning. The consultants encour- 
aged the subject-matter experts to 
base the situations on actual occur- 
rences. One such situation dealt 
with a State Trooper who had stopped 
a car for speeding, while obtaining 
icense information, the Trooper was 
assauited by three motorists from 
another car. Because the Trooper 

™!L?a SaU u 1 ted and beaten ' there was 
considerable discussion, with the 
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conclusion that there was no single 
"right" answer. Several possible 
actions were collected, and a sample 
test item, which was not used in the 
actual examination, was prepared 
(Hardt et al. , 1981, p. 27) . 

In the final examination, the 
key value for each alternative was 
based on the mean ratings made by 
nine Troopers and nine Sergeants, 
who had been nominated by the Zone 
Lieutenants from the nine NYSP 
troops on the basis of their superi- 
ority on two job elements, Thorough- 
ness and Good Judgment. For each 
item, the key values provided by 
these 18 white males were compared 
with the responses made by nine male 
minority group members and three 
white women, resulting in a median 
correlation of ,96 with the minori- 
ties and ,94 with the women (Table 
2). A larger scale analysis (Hardt 
et al,, 1981), based on the 560 
alternative responses to 76 situ- 
ational . items , also shows high and 
statistically significant correla- 
tions (p < .01) between the responses 
of the 18 white males and of the nine 
minorities (r = .95) and the women 
(£ " *89). Thus, there was high 
agreement among these groups. 

The scoring procedure was de- 
signed to give a maximum item score 
to candidates who selected as best 
the alternative with the highest key 
value and as worst the alternative 
with the lowest key value. Specif- 
ically, the item score for each 
candidate was obtained by subtract- 
ing the key value of the worst 
response from the key value of the 
best response. Thus, as shown by 
the mean keyed value in Table 1, a 
candidatA ^electing alternative 2 

. 14 ™,-..., ? gg worst 

score for 
linus a 
ive 3.0). 
idate 
the worst 
ould re- 
the item 
e 1.6 = 

1 test 
re made 
es and to 
core for 


The Situations Test item pool, 
amounting to 76 situations, was 
tried out on three groups of police, 
including NYSP Troopers and recruits 
from both a northeastern city and a 
mid-Atlantic city, for the purpose 
of studying the impact of the test 
on minorities and women. Another 
aim was to reduce the length of the 
test so that almost all of the NYSP 
candidates could be expected to 
complete the final Situations Test, 
which included 22 situations as 
well as 69 questions on hypothet- 
ical police rules, in a three-hour 
period . 

Since tryout data indicated 
that minorities, women, and white 
males might respond differently to 
the situational items, a plan was 
drawn up to make a statistical 
analysis of the Situations Test 
scores of the candidate population, 
examining both inter-item relation- 
ships and correlations between the 
test items and the self-ratings of 
the candidates (cf. Angoff & Ford, 
1971). The plan called for study- 
ing both within-group interactions 
of the test items, using two large 
white samples, and between-group 
interactions, using the white norm 
group, a random sample of 3,000 
white males, and large minority 
samples. The analysis focused on 
determining statistically signifi- 
cant differences in the response 
patterns of the groups to the 
situational items. 


The first step of the analysis 
involved determining whether the 
Situations Test, taken by 22,128 
candidates, showed adverse impact 
on minorities or women according to 
the four-fifths (80%) rule of thumb 
described in the 1976 Federal Execu- 
tive Agency (FEA) Guidelines on 
Employee Selection Procedures (U.S. 
Department of Justice, U.S. Depart- 
ment _ of _ Labor & U.S. Civil Service 
Commission, 1976, p. 51753). By 
is rule, adverse impact normally 
exists where the selection rate 
for a racial, ethnic, or sex group 
is less than 80% of the rate of 
the group with the highest selec- 

5}J" ^ te ‘ Th e cutoff score on the 
Situations Test was set so that the 
top-scoring 4,310 (19%) of the 
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Correlations Between the Mean Keyed Values for Alternatives of Key Value Group 
with Minority Group and with Women for 18 Situations Test Items 


Situations Test 

Items 

No. of Alternatives 
in Test Item 

Minority Group 
n « 9 

Women 
n = 3 

a 

13 

.92** 

.85** 

b 

9 

.91** 

.72* 

c 

9 

, 94** 

. 91** 

d 

8 

. 98** 

.95** 

e 

8 

. 98** 

, 97** 

f 

9 

. 83** 

. 83** 

g 

7 

.97** 

. 96** 

h 

6 

. 97** 

.99** 

i 

11 

, 96** 

, 9 8 ** 

j 

8 

.98** 

.98** 

k 

7 

, 94 ** 

.93** 

1 

7 

, 94** 

. 96** 

m 

8 

.96** 

.95** 

n 

6 

. 98** 

. 93** 

o 

6 

.89* 

.73 

p a 

7 

. 94** 

.53 

q a 

9 

. 9 7** 

.65 

r b 

7 

, 99 ** 

. 96** 

Median correlation 


.96 

.94 


Nott^. The Key Value Group consisted of nine white male Troopers and nine white male 
Sergeants, nominated as superior on Judgment and Thoroughness and representing nine Troops. 
Minorities and women were nominated by the Minority Group Recruiter and a minority group 
member of the Job Analysis Detail. Items a thru o and seven other items were in the final 
test . 

a This item was dropped from the test after tryout data from a mid-Atlantic city showed 
possible differences in race and sex response patterns, 

b This item was dropped because of its racially sensitive content. 

*£ < .05 

**p < .01 


candidates would be eligible to take 
the Physical Performance Test (PPT). 
The NYSP established the cutoff score 
chiefly on the basis of two adminis- 
trative considerations: the high 
cost of administering the PPT at four 
sites throughout the State, and their 
estimate that only 2,500 of the can- 
didates would be considered in order 
to fill a maximum of 800 funded 
vacancies. By examining the statis- 


tical impact ratio of the 22-item 
test for the various subgroups, we 
found that the pass rate of women 
to men (86%) did not show adverse 
impact on the basis of sex. But 
the test did show adverse impact oi 
minorities. In relation to white 
male candidates, the pass ratio wa. 
35% for black males and 48% for 
Hispanic males. A similar set of 
statistics was calculated for each 
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of the 22 situations items based 
on median score differences of sub- 
groups, identifying 11 items that 
might have different response pat- 
terns for minority males and white 
males . 

The 11 items were examined, 
analyzing item intercorrelations for 
a random sample of 1,000 white males, 
a random sample of 1,000 black males, 
and the total sample of 876 Hispanic 
males, as contrasted with a white 
norm group of 3,000 white males 
(Hardt et al., 1981). For the inter- 
item analysis, a vector of 21 corre- 
lations — each situational item was 
correlated with the remaining 21 
situations — was established for each 
subgroup, and a statistical test was 
made to determine whether the corre- 
lation of the vectors between the 
white norm group and the white sam- 
ple was higher than the correlation 
between the white norm group and 
the black or the Hispanic groups. 

None of the differences between 
these correlations was statistically 
significant at the 5% level. How- 
ever, one of these items — the one 
with the highest discrepancy between 
the whites and the blacks — was 
dropped because the results showed a 
differential response pattern similar 
to that found in the mid-Atlantic 
and NYSP tryout samples. 

The second set of statistical 
tests involved comparing the item 
responses of the three subgroups 
with their self-ratings on the sub- 
elements, on which the candidates 
rated themselves on a scale ranging 
from 2 (do not have or cannot rate) 
to 6 (outstanding). The vector for 
the white norm group was compared 
with the vectors for the white 
sample, the black sample, and the 
Hispanic group. This time, statis- 
tically significant differences were 
found between the white and black 
sample vectors for two of the ten 
situations under consideration (Item 
16: r’s *. .28 & .09, z « 2.07, N - 
223, p < .05; Item 21: r's = ,36 & 
•13, z =2.58, N « 223, £ < .01). 
These two items (item 21 given in 
Table 1 ) showed differential valid- 
ity (Katzell & Dyer, 1977) between 
the response patterns of large 
groups of white and black males, 


and according to the prearranged 
plan, were dropped from the final 
scoring key used for the Situations 
Test. 

By dropping the three test 
items, we have seen a slight 
decrease in the adverse impact of 
the test. The ratio of selection 
rates for black males rose to 38%, 
up from 35%, and the ratio for 
Hispanics rose to 49%, up from 48%. 
In an earlier paper (Eyde et al., 
Note 1) we found that the Physical 
Performance Test (PPT), based on 
critical worker requirements and 
prepared by incumbents familiar 
with superior job performance, shows 
adverse impact on women candidates. 
That test, consisting of five pass 
or fail subtests and four subtests 
used for ranking candidates, was 
designed to measure one of the 15 
key requirements of the job, Ability 
to Combine Personal Resources: Men- 
tal and Physical. A total of 3,627 
candidates, including 90 women, com- 
pleted the PPT after having passed 
the screenout section of the test. 
Ninety-nine percent of the men but 
only 67% of the women passed the 
screenout portion of' the PPT. For 
the screenout portion of the PPT, 
the selection rate for women was 
only 68% of the selection rate for 
men, so that adverse impact as 
defined by the 80% rule of thumb 
existed . 


Documenting the Validity 
Q f the Ex am i n a t i o n 

The NYSP documentation effort 
centered on identifying the content 
representation of the test in terms 
of the critical requirements of the 
performance domain. The test devel- 
opment process was based on the 
important requirements of the job. 

In addition, we corroborated the 
match of test content with job con- 
tent by identifying statistically 
significant (p < ,05) relationships 
between the test scores of candi- 
dates and their self-ratings on 223 
subelements . After this step was 
completed, the job elements under 
which the subelements were classi- 
fied were examined. The content of 
the test, described in terms of the 
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performance domain, was reported 
under the key job elements, for exam- 
ple, Thoroughness, Good Judgment, and 
the Ability to Make Decisions. 


Considerable care was exercised 
in selecting a validation sample for 
the NYSP project that would meet 
professional and legal requirements. 
For example, the FEA Guidelines 
(U.S. Department of Justice et al., 
1976, p. 51755) noted that a 
research sample used in a criterion- 
related validity study "should inso- 
far as feasible be representative of 
candidates normally available in the 
relevant labor market for the job or 
jobs in question, and should insofar 
as feasible include the racial, eth- 
nic and sex groups normally avail- 
able in the relevant job market." 
Problems associated with documenting 
validity evidence using samples of 
experienced workers have been iden- 
tified in key court cases, for exam- 
ple, Albemarle Paper Co. v. Moody 
(1975)5 and League of United Latin 
American Citizens~v". City of Santa 
Ana ( 1976). 2 Thus our documentation 
of the validity of the Situations 
Test included data based on the 
entire test population for minori- 
ties and women, ranging in popula- 
tion size from 928 Hispanics to 
1,336 blacks. A similar-sized ran- 
dom sample of 1,000 white males was 
used in computing the correlations 
for the white population. Self- 
ratings, which were documented with 
examples of life experiences show- 
ing competency, were used as the 
best estimate of job performance 
that was available for subgroups in 
the applicant population, which are 
relatively large, especially in the 
initial stage of the selection 
process. Correlations between test 
scores and self-ratings provide 
statistical information about high 
and low scoring candidates which 
aid in interpreting test results in 
terms of estimated job performance. 
Because of the low selection ratio 
in the NYSP project, with its 
attendant problems of restriction 


of range, it will not be feasible 
to conduct criterion-related valid- 
ity studies on a sample representa- 
tive of the candidate subgroups, 
usinq supervisory ratings or more 
objective measures of job perform- 
ance. There simply will not be 
adequate statistical power to sup- 
port such a study. 

The job elements showing a 
large proportion of subelements 
with statistically significant cor- 
relations between the test scores 
and the self-ratings for the major 
minority groups and women as well 
as for the total applicant popula- 
tion are given in Table 3. (Data 
for 1,163 women are considered even 
though the test did not show adverse 
impact by sex. For a complete list- 
ing of all the subelements involved 
in the correlation matrix, see Tordy 
et al., 1976, pp. 89-105 and Hardt 
et al., 1981, Appendix Table 0.) 

The analysis of significant 
correlations focused on subgroups 
with optimal sample sizes of approx- 
imately 1,000 in each subgroup. 

Thus, it is possible to examine the 
subelements that' showed statisti- 
cally significant relationships 
across subgroups, rt was found that 
a total of 68 subelements or 30% of 
all the subelements showed statisti- 
cally significant correlations, at 
the 5% level, for at least three of 
the four groups, i.e., women, and 
white, black, and Hispanic males. 

Not as much practical significance 
is attached to statistically signi- 
ficant correlations based on the 
total group, because very low corre- 
lations are statistically signifi- 
cant for data collected from over 
21,000 candidates. 


Job Content Measured by Situations 
Test 


What are the key job elements 
measured by the Situations Test? 
Before we answer this let us review 


^ Albemarle Paper Co, v. Moody . 422 U.S. 405 (June 25, 1975). 

2 ..... . 

League of United Latin American Citizens v. City of Santa Ana. 10 F Supp. 873 

(March 12~ 1976). — ' ' ' 
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Numb* cally Significant Correlations Between Situations Test Total Scores and Rankable 

Self-Ratings by Total Group and by Race, Ethnic, and Sex Subgroup 
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A list of the correlations may be obtained from the first author. The data are also available in Hardt , Eyde, 
Primoff, and Tordy, 1981. The range of obtained statistically significant correlations for the subgroups is: 



the main concepts used in the job 
element method. The key job elements 
ace selected on the basis of high 
Total Value scores (Primoff, 1975). 
These elements show a very high 
degree of differentiation between 
highly superior and marginal work- 
ers. Subelements, which also con- 
tribute to the identification of 
superior workers, are selected on 
a basis of high Item Index scores 
and of ratings of Barely Acceptable. 
Subelements provide descriptions of 
the specific content of the job, 
functioning as operational defini- 
tions of the job elements under 
which they are classified, and are 
used for constructing test items. 

With these concepts in mind, let us 
examine the statistically signifi- 
cant correlations between the Situ- 
ations Test scores and self-ratings 
on the subelements, in order to 
identify the key job elements mea- 
sured by the Situations Test (Table 
3). By selecting the job elements 
with the highest proportion of sta- 
tistically significant correlations 
between the test and self-ratings, 
we find that the key job elements 
defined in terms of subelements — 
shown to be of considerable impor- 
tance to success through the job 
analysis--are s Thoroughness (50%); 
Possess Good Judgment (39%); and 
Have Common Sense (38%). Other job 
elements that have only a small num- 
ber of subelements classified under 
them are also well represented: 
Ability to Make Decisions (100%); 
and Ability to Work without Supervi- 
sion (50%). 

The job elements measured by 
the Situations Test are best under- 
stood by the subelements that were 
classified under them by a panel of 
police. The following subelements, 
used as examples for key job ele- 
ments, each showed statistically 
significant correlations between the 
total test scores and self-ratings 
for the white, black, and Hispanic 
men and for women (Hardt et al., 
1981). Thoroughness is illustrated 
by the subelements: "Ability to 
recall all items of knowledge which 
will control your course of action"; 
and "Ability to remember basic 
elements of the law." Judgment is 
represented by the subelement: 


"Ability to apply past experience 
to solve problems." Common Sense is 
exemplified by these subelements: 
"Ability to establish priorities of 
different tasks" as well as by 
"Resourcefulness." The job element, 
Ability to Make Decisions, is mea- 
sured by these subelements: "Ability 
to plan" and "Flexibility, for exam- 
ple, be able to respond equally well 
to different situations." And 
finally, the job element, Ability to 
Work Without Supervision, is defined 
by the subelement: "Ability to read 
and understand written instruc- 
tions." Thus, the content of the 
performance domain helps to describe 
the job elements measured by the 
Situations Test. 

Let us now review the validity 
evidence for the ranking portion of 
the Physical Performance Test (PPT), 
which was based on four subtests: 

(a) Police Foot Pursuit Course; 

(b) Distance Chase; (c) Attic 
Opening Climb; and (d) Drag Dummy 
from Vehicle. The self-rating 
scores, based on the sum of the rat- 
ings of the 17 subelements classi- 
fied under the job element. Ability 
to Combine Personal Resources: Men- 
tal and Physical, were correlated 
with the scores actually obtained on 
the PPT, For each sex, the correla- 
tions were found to be statistically 
significant (£ - .32 for men, n = 
3419; £ = .42 for women, n = 86). 

In other words, among both men and 
women, candidates who received 
higher scores on the PPT tended to 
be those who had rated themselves 
higher on this job element several 
months prior to taking the PPT. The 
PPT scores show the highest correla- 
tions of both men and women with the 
single subelement, "Ability to run 
at your top speed over rough terrain 
and around obstacles" (jc's = .45 and 
.42, respectively), and with the 
four-item subscale, "Speed and agil- 
ity" (r = .50 for men; r = .45 for 
women ) . 

Twelve of the 17 subelements 
under the job element. Ability to 
Combine Personal Resources, showed 
statistically significant relation- 
ships between the self-ratings and 
PPT scores for both sexes. The 
five subelements that did not show 
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statistically significant correla- 
tions dealt with subelements that 
the PPT was not designed to measure: 
vision requirements/ manual dexter- 
ity, handcuffing a resisting person, 
and characteristics associated with 
discouraging physical attack. 

The PPT results add 10 more 
subelemen ts — above and beyond those 
measured by the written test — to the 
number of subelements measured by 
the job element examination. (Two 
subelements, relating to stamina and 
sedentary activities, related to both 
the written and the physical perform- 
ance tests.) Thus the ranking portion 
of the examination measures 7 8 or 3 5% 
of the critical subelements of the 
performance domain. 


Economic considerations curbed 
the comprehensiveness of the job 
element examination. Had it included 
the background investigation, and 
the oral and medical examinations, 
and empirically weighted self-rating 
we might have been able to measure 
more of the important subelements. 
For example, these subelements, 
which on the basis of the job analy- 
sis were found to contribute to the 
identification of highly effective 
workers (Item Index range: 84-87 
[see Primoff, 1975] ) might have been 
measured: "Ability to work as a mem- 
ber of a team 1 '; "Have respect for 
authority' 1 ; and "Have the desire to 
be a Trooper." We might have also 
been able to obtain documented evi- 
dence that we measured these 
requirements which were likely to 
cause trouble if they were left 
unconsidered (Trouble Likely ratings 
range: 93-97 [see Primoff, 1975]): 
"Wo previous employment in illegal 
activities"; "Wo dangerous drug 
addiction"? and "Ability to maintain 
emotional stability without use of 
d r ugs . 11 


A fiscal crisis faced by the 
New York State Police prevented 
further study of the validity of 
self-ratings, using larger samples 
of superior police nominated from 
each troop on the basis of their 
superiority on the elements. 
Thoroughness and Good Judgment. A 
pilot study (Hardt et all, 1981) 
showed that the mean ratings on 123 


subelements made by nine Troopers, 
nominated for their superiority on 
these elements, were significantly 
higher than ratings made by 71 
randomly selected NYSP Troopers (t ~ 
11.34, df = 244, p < .01) . 

The economic recession, as well 
as the general popularity of the 
Trooper job, had an impact on the 
EEO results. For example, despite 
the fact that in 1975 a large-scale 
recruitinq effort was carried out 
to attract minorities and women, a 
substantial increase in the number 
of white male applicants occurred: 
over 15,000 more white males applied 
for the job than in 1973. And yet 
no more than 800 Troopers might be 
hired. Out of the 3,534 males on 
the eligibility list, based on the 
PPT and the Situations Test, there 
were only 188 (5%) males who were 
minority group members. The distri- 
bution of these minority group males 
along the eligibility list did not 
differ significantly at the 5% level 
from that of the white males (chi 
square - 4.92, df = 6). Therefore, 
as one moves down the eligibility 
list and more hiring occurs, the 
more minority group members there 
will be. When jobs are in short 
supply and the job involved is an 
extremely popular one, there must 
be a relatively large number of 
funded vacancies in order to show a 
substantial increase in the hiring 
of minority group members. 

Veterans' preference points — in 
this case five or ten points as 
required by the State constitution — 
also affect who will be first hired. 
For example, 99 of the top 100 
candidates on the eligibility list 
had veterans' credits. A similar 
proportion of white, black, and 
Hispanic males received veterans' 
credits (range, 20% to 22%). How- 
ever, only one of the 45 candidates 
who received 10 veterans' credits, 
awarded on the basis of a disabil- 
ity, was a minority group member. 

Not one of the 778 candidates with 
veterans’ credits was a woman. 
However, in this particular exami- 
nation, in which the women were 
already clustered towards the 
bottom of the list, their lack of 
such credits had little practical 
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impact on their chances of being 
appointed. 

The group of women candidates 
showed a high attrition rate, a 
total of 90 women completed the PPT, 
Only 69% of the women eligible to 
take the Situations Test appeared 
for the test, whereas 76% of the men 
did. Furthermore, only 68% of the 
women eligible for the PPT appeared, 
whereas 89% of the men did. Of the 
minorities eligible to take the 
Situations Test, 69% took the test, 
whereas 77% of the white candidates 
did. On the other hand, 88% of the 
white candidates eligible for the 
PPT appeared, whereas 83% of the 
eligible minorities showed up. 

The results of this examination 
are that only 278 (8%) of the 3,627 
candidates on the eligibility list 
are women or minorities. As a 
consequence, the Superintendent of 
Police decided to set aside 25 of 
the first 100 academy positions for 
10 women and 15 minorities. Doing 
so required a substantial departure 
from the eligibility list treated on 
the basis of the competitive examin- 
ing process. As a result, a reverse 
discrimination class action suit, 
Ruddy v. Connelie ( 1977), 3 was filed 
wifc'K" "the New York State Supreme Court 
(New York State's lower level court) 
with the main issue being whether the 
appointment of the women and minori- 
ties was in violation of the State 
constitution. The court concluded 
that the action of the Superintendent 
deprived the petitioners of their 
rights, noting that the "administra- 
tive action intended to confer favor 
upon a few and to exclude others 
equally qualified under the law, is 
discriminatory, a denial of equality 
of privilege and opportunity, and of 
equal protection of the law" (p. 5). 
The decision was appealed and upheld 
( Ruddy v. Connelie , 1 9 7 8 ) 

On September 8, 1977, the At- 
torney General of the United States 


of America filed a lawsuit against 
the State of New York and Superin- 
tendent Connelie of the New York 
State Police in the U.S. District 
Court for the Northern District of 
New York (USA v. State of New York; 
Connelie et al ■ , 1979 ) , alleging a 
"pattern or practice" of discrimi- 
natory practices with respect to 
blacks, Spanish-surnamed Americans, 
and women under the provisions of 
Title VII of the Civil Rights Act 
of 1964, as amended. 

During the trial preparation 
period, defendants' consultant, 

C. H. Lawshe, prepared an addi- 
tional corroborative evaluation of 
the validity of the 1975 New York 
State Trooper examination. His con- 
sultant's report is presented in 
Appendix A. In it, Lawshe describes 
a three-category rating scale for 
evaluating the relevance of the 
subelements to the test items. The 
rating category Definitely Required 
was assigned a weight of 3, Useful 
a weight of 2, and Not Useful a 
weight of one. A test item was con- 
sidered relevant or linked to a sub- 
element if it had an average of 2.0 
or larger, i.e., each subelement is 
either Useful or Required. The 
weighting system was designed for 
use with competitively scored tests, 
in contrast to pass/fail tests in 
which only essential requirements 
are considered. Lawshe's (1975) 
earlier paper, on the other hand, 
described procedures for computing 
the Content Validity Ratio (CVR) 
designed to generate evidence for 
tests used for the preliminary 
screening of candidates. The CVR 
also used a three-category rating 
system (Essential; Useful But not 
Essential; or Not Necessary), but 
considered only Essential ratings 
in computing the Content Validity 
Ratio 


Lawi 

com] 


3 

Ruddy v. Connelie , Calendar Nos. 61 and 53, New 
Special Term, February 11, 1977. 

^ Ruddy v. Connelie ♦ No. 31292, New York State Su 
Judicial Department, February 23, 1978. 


13 



corroborative effort designed to 
identify subelements which showed 
statistically significant correla- 
tions between test items and self- 
ratings for at least three subgroups 
of candidates, including women and 
black, white, and Hispanic males. 
Appendix B lists the subelements 
that met the criteria established 
for both corroborations. It is 
interesting to note the kinds of 
subelements which met both corrobo- 
rative criteria, such as subelement 
lk, "Ability to recall facts" and 
subelement 15a, "Ability to size up 
and evaluate a situation." On the 
other hand, subelements lx, "Perse- 
verance," and 20b, "Ability to 
handle alcohol in moderation," did 
not meet the multimethod criteria 
(see Hardt et al. , 1981) . 

A twenty-four day trial, which 
began May 31, 1978 and ended July 
21, 1978, was held. Key arguments 
in the trial and their scientific 
and philosophical background are 
described by Eyde, Primoff, and 
Hardt (Note 5) . 

On September 6, 1979, the 
U.S. District Court judge decided 
the case in favor of the plaintiff 
( U.S. A. v. State of New York , 1979). 
The examination, which showed dis- 
parate impact, was declared invalid 
and therefore unlawful, and the 
defendants were enjoined from using 
the 1975 examination "as is." The 
court stated that tasks were not 
collected in the job analysis, not- 
ing that "Although this information 
may have been within the collective 
knowledge of members of the job 
analysis detail, it was not and 
could not have been brought before 
members of the psychological profes- 
sion or the Court for scrutiny and 
consideration" (U.S. A v. State of 
New York , 1979, p. D-24) . The court 
ruled that the use of the content 
validity strategy alone, without 
evidence of criterion-related valid- 
ity, is inappropriate, it found 
that "many of the subelements 
identified through the job analysis 
and upon which the 1975 trooper 
examination was based are at or near 
the abstract or unobservable end of 
the occupational continuum and are 
psychological processes" ( U.S. A. v. 


State of New York , 1979, p. D-25), 
and that the examination's documen- 
tation was not in accordance with 
professional standards or in 
compliance with Federal Guidelines. 

The court ( U.S. A. v. State of 
New York , 1979, pT D-2 ) noted: "This 
has not been an easy decision. The 
factual findings necessitated in 
this area of law are enough to 
boggle the minds of even’ the most 
educated of psychologists and law- 
yers." The defendants were found 
to have "acted in good faith in 
attempting to eliminate discrimina- 
tion in its employment practices" 
( U.S. A. v. State of New York , 1979, 
p. D-2 7 ) . The court imposed hiring 
goals on the New York State Police, 
noting that "In this case, the pub- 
lic good is the benefit that flows 
from a State police force reasonably 
representative of the public it ser- 
vices" ( U.S. A. v. State of New York , 

1979, p. D-2). The court observed 
that 1% of the sworn personnel of 
the New York State Police were 
minorities or women and noted that 
the underrepresentation of these 
groups produced "startling and eye- 
catching statistics" ( U . S . A . v . 

State of New York , 1979, p. D-4 ) . 

The 'court did not cut off government 
funding; however the judge awarded 
14 months of back pay and retro- 
active seniority to three individ- 
uals. The decision was not appealed 
to a higher court. Thus judges out- 
side of the U.S. District Court for 
Northern New York are not bound by 
this decision. 

This decision is in line 
with the outcome of cases involv- 
ing U.S. A. as a plaintiff. In 
recent years, the U.S. Department 
of Justice has been involved in 
many police cases. "it has settled, 
either out of court or through liti- 
gation, such cases involving over 20 
police departments. All settlements 
have resulted in hiring and promo- 
tion quotas for specific numbers of 
minorities, including women, to cor- 
rect past discrimination" (Foster, 

1980, pp. 1, 7). Chief U.S. Judge 
Foley, who decided the case, told a 
reporter (Freedman, 1980, p. 2) 

"he believes his order was what the 
State actually wanted to be told but 
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was unwilling or unable to do on its black males, and 34 favored white 

own without a push from the Court." males. More research of this kind 

may provide further evidence that 
self-ratinqs may be used to reduce 

Further Research Directions adverse impact while gathering sup- 

- - - ' plemental information on candidates. 


As noted earlier, self-ratings 
may be used as a component of job 
element examinations. Self-ratings 
are based on subelements which iden- 
tify critical job requirements. One 
of the advantages involved in using 
self-ratings has been identified by 
Epstein (1980). He noted that it is 
possible to obtain valid and repli- 
cable information about individuals 
by using self-ratings which "although 
themselves [are] made on a single 
occasion are based on an adequate 
sample of observations in the past" 

(p. 801). 

The use of self-ratings in 
analyzing differential response 
patterns to situational test items 
has been described. Self-ratings 
may also be used as a supplement to 
other examination information. For 
example, objectively scored self- 
ratings may be used as an early 
step in the selection process. 

These self-ratings should later be 
reviewed — and if necessary modi- 
fied--as a result of evidence 
collected in background investiga- 
tions and oral examinations. There 
is some research evidence to support 
the hypothesis that self-ratings 
may be used as a selection procedure 
which reduces adverse impact. An 
analysis was made of how white and 
black male applicants rated them- 
selves on 223 subelements that were 
part of this examination. Using t 
values (2-tailed, significant at 1% 
level), it was found that blacks 
rated themselves higher on 96 sub- 
elements, whereas whites rated them- 
selves higher on 52 subelements. It 
is interesting to note that 71, or 
75%, of the 96 subelements on which 
blacks rated themselves significantly 
higher than whites were also found to 
be subelements linked with at least 
one test item on the basis of an ex- 
perienced panel of police represent- 
ing the nine troops and including 
minorities and one woman. Among the 
subelements listed in Appendix A, 
Table B, 71 were found to favor 


Summary 


This research and development 
project sought to combine equal 
employment opportunity concerns with 
the need for documenting the valid- 
ity of the examining process, using 
the job element method. As a result, 
we have a better understanding of 
what is required to perform entry- 
level police work effectively and 
have made a data bank of critical 
worker requirements available for 
other police agencies to use. The 
key job elements of Thoroughness, 
Good Judgment, and Ability to Com- 
bine Personal Resources: Mental 
and Physical, were supported in 
considerable detail by the specific 
requirements of the police job. 

We have shown the link between the 
important requirements of the per- 
formance domain and the content of 
the job element examination. A 
procedure for identifying differen- 
tial response patterns of minority 
group members was described. In 
addition, we have shown how the sup- 
ply and the demand for the police 
job and fiscal crises affected the 
application of the job element 
method and had impact on the hiring 
of minorities and women. 
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AN ANALYSIS OP THE CONTENT VALIDITY OF THE 
1975 NEW YORK STATE POLICE EXAMINATION 

This is a report of your consultant's professional 
involvement in the evaluation of the 1975 New York State 
Police Examination. 

Initial Contact 

Following an initial contact on Peb. 13 , 1978/ your con- 
sultant spent approximately two days examining file materials, 
the principal item of which was an early draft of what was 
subsequently published April 1978 as The New York State 
Trooper Job Element Examination by Hardt, Eyde, Primoff and 
Tordy. This analysis led to the following opinions: 

“ The job analysis was conducted in an exceptionally 
careful and professional manner. 

- The test item generation process was well conceived 
and carefully executed. 

Great care was exercised in the execution of numerous 
procedures utilized to reject inappropriate items. 

- The test scoring procedure was adopted only after 
intensive consideration of alternate procedures. 

Numerous considerations, including the above, led your 

consultant to conclude that the test is truly job related and, 

hence, is valid. Subsequent to this initial evaluation your 

consultant agreed to be retained as an expert witness. 

Content Validity Analysis 

While your consultant initially concluded that the exami- 
nation is valid, such conclusion was supported largely by 
inferences drawn from the job analysis and test construction 
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procedures utilized. Consequently, he proposed a supple- 
mentary validity analysis with the expectation that it would 
provide data to corroborate the conclusion already reached. 

The procedure was a content validity analysis and consisted of 
the following three steps: 

1. Convene a Content Evaluation Panel 

2. Submit each test item to Panel members and ask 
for a judgment regarding the relevance of each 
sub element identified in the job analysis. 

3. Summarize the results in order to assess the 
content validity of the examination. 

Each step is dealt with independently in this report. 

Content Evaluation P anel 

The Panel consisted of 18 job experts with one Trooper 
and one Sergeant from each of nine Troops. Nine members (in- 
cluding one woman, one male black, and one male Hispanic) were 
selected by their Troop Commanders on the basis of good judg- 
ment and thoroughness; the remaining 11 were nominated earlier 
by the same process described in the above mentioned report. 

Panel Judgments 

Each Panelist was provided with one test item at a time, 

(i.e., police situation or a description of one of the physical 

performance sub-tests) and a list of the sub-elements included 

in the job analysis. The following question was asked for the 

physical performance items: 

To what*extent does performing this work sample 
involve the use of the knowledge, skill, ability 
or other characteristic (KSAO) presented in the 
sub element? 
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Three alternative answers were provided: 

A. Definitely required 

B. Useful 

C. Not useful 

The question was modified only slightly for the written 
portion of the examination involving police situations. In 
totals each of the 18 Panelists examined 205 sub-elements in 
relation to each of 19 situation test items; he examined the 
content of 4 physical performance sub-tests in relation to 17 
sub-elements. 

Summary of Results 

Pooled Result . For each test item for each sub-element, 
individual ratings for 18 Panelists were available. These 
were pooled by (a) assigning values of 3, 2, or 1 to the 
response .alternatives above and (b) computing the mean or 
average. The test item was considered relevant or linked to 
a sub-element if it had an average of 2.0 or larger which is 
equivalent to the Panel, as a whole, saying that that sub- 
element is "useful" or "required". 

Physical Performance Test . Results of the content validity 
analysis of the Physical Performance Test are presented in 
Table 1? Note that the attic climb sub-test is relevant to 
3 sub-elements, the distance dash is relevant to 8, weight 
pulling 6, and foot pursuit 8. Of the sub-elements examined, 
linkage with at least one item (or sub-test) was demonstrated 
for 13 or 77% of the 17. 

*Here Table A, 
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Police Situations . Results of the content validity 
analysis of the written portion of the test are presented in 
Table 2.* The number of sub-elements for which test items are 
relevant range from a minimum of 25 to a maximum of 68. Of 
the sub-elements examined, linkage with at least one test item 
was demonstrated for 163 sub-elements or 80% of the 205. 

Conclusion 

In the opinion of your consultant, the data generated by 
this analysis have demonstrated the content validity of both 
parts of the examination and serve to corroborate the earlier 
conclusion that the test is valid. 


Respectfully submitted 



C.H. Lawshe, PhD 

Licensed Psychologists Georgia, Indiana, 

Kentucky & Pennsylvania 

May 27, 1978 

NOTES This report is an edited version of a preliminary 
draft signed and submitted May 25, 1978. No substantial 
changes have been made; all modifications are purely editorial 
in nature and were made solely for purposes of clarification. 

- CHL 

*Here Table B. 
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TABLE B 

Sub element- Situations Test Item Linkage Values with Average of 2.0 or Greater Assignea by Sutject Matter E-per 
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TABLE B (Continued) 
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Sub elements Situations Test Items 
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APPENDIX B 


A Comparison of Two Corroborations of the Content Validity 
of the 1975 Examination 


Subelements Linked to Situations Test and Physical Performance Test by 
Both the Subject-Matter Experts and Statistically Significant 
Correlations Between the Test Scores and Self-ratings by Candidates on 
Subelements 


lk Ability to recall facts 

In Ability to remember basic elements of the law 

lp Ability to recall all items of knowledge which will control your 
course of action 

2f Ability to size up a situation quickly 
3i Ability to stand by decisions 
4a Self-reliance 

4b Flexibility, for example, be able to respond equally well to different 
situations 
4c Ability to plan 

5a Ability to work alone 

6f Trustworthiness 

7a Willingness to mask prejudices and enforce the law objectively 
7f Ability to establish priorities of different tasks 
7g Resourcefulness 
7j Ability to be discreet 

71 Ability to use tact 

8c Willingness to conform to existing standards of the job 

9a Ability to remove a 160 pound person from a car against his will 
9b Sufficient strength to raise your body through an overhead hole, 
such as attic entrance 

9c Possess physical strength to control violent persons, a runaway 
cow or horse 

9d Ability to restrain an intoxicated person weighing approximately 
200 pounds 

9h Ability to function after running 200 yards at your top speed 

9i Ability to run at your top speed over rough terrain and around 

obstacles 

9j Ability to run 1/2 mile while chasing a person 
9k Stamina to walk long distances over rough terrain 

91 Ability to work in different types of terrain, for example, mountain 
or forest 

9m Ability to make instant change from sedentary activity to strenuous 
physical activity 
9n Good physical coordination 

9o Endurance, for example, working long hours or walking five miles in 
wooded terrain 
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APPENDIX B — (Continued) 


Lli Ability to do more than one thing at a time, such as a busy Trooper 
on desk duty taking complaints, making assignments and using 
station radio console 


12a Ability to express yourself orally 

12c Have good command of the English language in its written and spoken 
form 

12n Persuasiveness 

13a Willingness to provide a public service to the people of your community 
in a law enforcement capacity 

13c Pride in the police profession 

14a Ability to recognize and deal with human emotions 

15a Ability to size up and evaluate a situation 

1 5 f Ability to apply past experience to solve problems 

1 5 g Basic investigative ability 

18a Ability to enforce the law fairly and equally towards all segments of 
the population 

18e Ability to avoid abuses of your position, such as giving or receiving 
personal favors 

18g Ability to resist intimidation 

19b Ability to size up a situation and take or initiate proper action 


21c Versatility 


Note. Subelements are listed if: (1) rated on the average "useful" 
or better by subject-matter experts for four or more of 19 situations; and 
(2) statistically significant correlations with the Situations Test were 
obtained for three or more applicant subgroups, including white males, 
black males, Hispanic males, and women (see Table 0 in Hardt et al,, 1978). 
For the Physical Performance Test subelements are listed if: (1) rated 
on the average "useful" or better by subject-matter experts for one or 
more of the four ranked subtests; and (2) statistically significant cor- 
relations with the Physical Performance Test were obtained for both men 
and women (see Table IV-14, Hardt et al., 1978). 
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